ABSTRACT
Chatbots have become an increasingly popular tool in the field of health services and communications. Despite chatbots' significance amid the COVID-19 pandemic, few studies have performed a rigorous evaluation of the effectiveness of chatbots in improving vaccine confidence and acceptance. In Thailand, Hong Kong, and Singapore, from February 11th to June 30th, 2022, we conducted multisite randomised controlled trials (RCT) on 2,045 adult guardians of children and seniors who were unvaccinated or had delayed vaccinations. After a week of using COVID-19 vaccine chatbots, the differences in vaccine confidence and acceptance were compared between the intervention and control groups. Compared to non-users, fewer chatbot users reported decreased confidence in vaccine effectiveness in the Thailand child group [Intervention: 4.3 % vs. Control: 17%, P = 0.023]. However, more chatbot users reported decreased vaccine acceptance [26% vs. 12%, P = 0.028] in Hong Kong child group and decreased vaccine confidence in safety [29% vs. 10%, P = 0.041] in Singapore child group. There was no statistically significant change in vaccine confidence or acceptance in the Hong Kong senior group. Employing the RE-AIM framework, process evaluation indicated strong acceptance and implementation support for vaccine chatbots from stakeholders, with high levels of sustainability and scalability. This multisite, parallel RCT study on vaccine chatbots found mixed success in improving vaccine confidence and acceptance among unvaccinated Asian subpopulations. Further studies that link chatbot usage and real-world vaccine uptake are needed to augment evidence for employing vaccine chatbots to advance vaccine confidence and acceptance.
ABSTRACT
BACKGROUND: Vaccine hesitancy is one of the many factors impeding efforts to control the COVID-19 pandemic. Exacerbated by the COVID-19 infodemic, misinformation has undermined public trust in vaccination, led to greater polarization, and resulted in a high social cost where close social relationships have experienced conflict or disagreements about the public health response. OBJECTIVE: The purpose of this paper is to describe the theory behind the development of a digital behavioral science intervention-The Good Talk!-designed to target vaccine-hesitant individuals through their close contacts (eg, family, friends, and colleagues) and to describe the methodology of a research study to evaluate its efficacy. METHODS: The Good Talk! uses an educational serious game approach to boost the skills and competences of vaccine advocates to have open conversations about COVID-19 with their close contacts who are vaccine hesitant. The game teaches vaccine advocates evidence-based open conversation skills to help them speak with individuals who have opposing points of view or who may ascribe to nonscientifically supported beliefs while retaining trust, identifying common ground, and fostering acceptance and respect of divergent views. The game is currently under development and will be available on the web, free to access for participants worldwide, and accompanied by a promotional campaign to recruit participants through social media channels. This protocol describes the methodology for a randomized controlled trial that will compare participants who play The Good Talk! game with a control group that plays the widely known noneducational game Tetris. The study will evaluate a participant's open conversation skills, self-efficacy, and behavioral intentions to have an open conversation with a vaccine-hesitant individual both before and after game play. RESULTS: Recruitment will commence in early 2023 and will cease once 450 participants complete the study (225 per group). The primary outcome is improvement in open conversation skills. Secondary outcomes are self-efficacy and behavioral intentions to have an open conversation with a vaccine-hesitant individual. Exploratory analyses will examine the effect of the game on implementation intentions as well as potential covariates or subgroup differences based on sociodemographic information or previous experiences with COVID-19 vaccination conversations. CONCLUSIONS: The outcome of the project is to promote more open conversations regarding COVID-19 vaccination. We hope that our approach will encourage more governments and public health experts to engage in their mission to reach their citizens directly with digital health solutions and to consider such interventions as an important tool in infodemic management. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): PRR1-10.2196/40753.